Asymmetric facial expressions: revealing richer emotions for embodied conversational agents

In this paper, we propose a method to achieve effective facial emotional expressivity for embodied conversational agents by considering two types of asymmetry when exploiting the Valence-Arousal-Dominance representation of emotions. Indeed, the asymmetry of facial expressions helps to convey complex emotional feelings such as conflicting and/or hidden emotions due to social conventions. To achieve such a higher 1 degree of facial expression in a generic way, we propose a new model for mapping the Valence-Arousal-Dominance emotion model onto a set of twelve scalar Facial Part Actions (FPA)s built mostly by combining pairs of antagonist Action Units (AU) from the Facial Action Coding System (FACS). The proposed linear model can automatically drive a large number of autonomous virtual humans or support the interactive design of complex facial expressions over time. By design our approach produces symmetric facial expressions, as expected for most of the emotional spectrum. However more complex ambivalent feelings can be produced when differing emotions are applied on the left and right sides of the face. We conducted an experiment on static images produced by our approach to compare the expressive power of symmetric and asymmetric facial expressions for a set of eight basic and complex emotions. Results confirm both the pertinence of our general mapping for expressing basic emotions and the significant improvement brought by asymmetry for expressing ambivalent feelings.